Tags → #ai security

Vulnerabilities
Research Highlights Vulnerabilities in Large Language Models Security
Nov 21, 2024 A new paper examines the vulnerabilities of large language models in enterprise settings, emphasizing the need for a comprehensive understanding of security risks across software and hardware components in compound AI systems.
Tools
New Concept of Defendability Against Backdoors in Machine Learning
Nov 19, 2024 Researchers from the Alignment Research Center have proposed a new formal concept of defendability against backdoors in machine learning models, framing it as a strategic game between an attacker and a defender.
Threats
Jailbreaking Techniques and Security Risks in Large Language Models
Nov 17, 2024 The practice of jailbreaking Large Language Models (LLMs) involves manipulating AI systems to produce unintended outputs, raising concerns about potential security vulnerabilities and prompting research into enhancing their security.
Vulnerabilities
Research Paper Proposes New Method to Combat Backdoor Attacks
Nov 15, 2024 A research paper from The Chinese University of Hong Kong, Shenzhen, introduces a novel method called Distance-Driven Detoxification (D3) to enhance defenses against backdoor attacks in machine learning models.
Vulnerabilities
Study Identifies Vulnerabilities in Google’s Vertex AI Platform
Nov 12, 2024 A recent study by Palo Alto Networks identified two significant vulnerabilities in Google’s Vertex AI platform that could allow attackers to escalate privileges and exfiltrate sensitive machine learning models.
Industry
HackerOne Report Highlights AI's Impact on Cybersecurity
Nov 11, 2024 The 2024 Hacker-Powered Security Report by HackerOne highlights the growing intersection of artificial intelligence and cybersecurity, revealing concerns among security leaders about AI risks and the increasing focus on AI safety vulnerabilities.